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Abstract — This paper proposes a novel scheme, based on pro- 
gressive fountain codes, for broadcasting JPEG 2000 multimedia. 
In such a broadcast scheme, progressive resolution levels of 
images/video have been unequally protected when transmitted 
using the proposed progressive fountain codes. With progressive 
fountain codes applied in the broadcast scheme, the resolutions 
of images (JPEG 2000) or videos (MJPEG 2000) received by 
different users can be automatically adaptive to their channel 
qualities, i.e. the users with good channel qualities are possible 
to receive the high resolution images/vedio while the users with 
bad channel qualities may receive low resolution images/vedio. 
Finally, the performance of the proposed scheme is evaluated 
with the MJPEG 2000 broadcast prototype. 

I. Introduction 

Broadcast [T| offers the promise of overcoming the band- 
width limitation in wireless communications by using one 
channel to transmit data to all users. Therefore, in many com- 
munication networks broadcast is often desired and required. 
For example, in 3G UMTS cellular networks. Multimedia 
Broadcast Multicast Service (MBMS) llj has been proposed 
as a standard of 3GPP for providing multimedia service to 
users via broadcast. 

In a broadcast network, multimedia plays a key role as 
it is the content to be transmitted, and it mainly includes 
the forms of text, audio, images and video. As the state-of- 
art image compression standard. Joint Photographic Experts 
Group 2000 (JPEG 2000) 1 3 1 is pervasive in broadcast network 
since it is capable of providing efficient image or even video 
(Motion JPEG 2000, MJPEG 2000) information content to 
the users. JPEG 2000 has already been issued recently as 
the standard by ISO/IEC 15444 [?] for supporting lossy and 
lossless compression of images. The success of JPEG during 
the past decade also implies a wide application of JPEG 
2000 in communication systems in the future. One of the 
most attractions of JPEG 2000 is that it is able to produce 
progressive recovery of an image by fidelity or resolution. 

Besides, the wireless transmission techniques are also im- 
portant for a broadcast network since they offer the carrier for 
multimedia content. Fountain codes (also known as rateless 
erasure codes) is one of such wireless transmission technique 
in which the original source symbols can be accurately recov- 
ered from any subset of the encoding symbols with the size 
equal to or only slightly larger than the number of source 
symbols. Luby Transform (LT) codes 13 or Raptor codes 
lis), as two state-of-art techniques of fountain codes, have 



been proved to be an efficient forward error correction (EEC) 
solution for erasure channel^. These codes are universal for 
different scenarios on packet transmission level regardless of 
channel packet loss patterns. So, fountain codes are becoming 
increasingly popular in broadcast network. For example. Rap- 
tor codes, with nearly linear encoding/decoding complexity, 
have been accepted for the application layer EEC scheme in 
current communication standards, such as 3GPP MBMS fl] 
and DVB-H |6|. 

In JPEG 2000 broadcast networlJl, scalable image/video 
transmissions can be achieved once considering the progres- 
sive levels of images in JPEG 2000 format or the progressive 
levels of frame images in MJPEG 2000 format. However, when 
applying fountain codes to scalable image/video transmissions 
in such a broadcast network, unequal error protection (UEP) 
strategies have to be considered since different levels of im- 
ages/video have different priorities. Recently, there are several 
UEP methods proposed for scalable image/video streaming. In 
Q, ID and data of each priority level are encoded and 
decoded by different sets of fountain codes separately, leading 
to rather high complexity and large overhead. Another method 
in ifTOl changes the degree distribution in order to encode the 
layered stream data together with UEP ability, but it decreases 
the decoding efficiency resulting in a larger overhead. In lITTI . 
hierarchical coding graphs are proposed to obtain different 
decoding paths for layered encoded symbol, but the overhead 
is still high due to a fixed structure of the coding graph. 

In this paper, for scalable image/video stream transmission, 
a progressive fountain codes is proposed to apply UEP to the 
broadcast of each progressive level information of JPEG 2000 
images, with high efficiency and low complexity. Beyond the 
proposed progressive fountain codes, unequal error protected 
JPEG 2000 broadcast scheme is designed with the purpose that 
different users can receive broadcasting images/videos with 
different resolutions according to their channel qualities. The 
framework of such JPEG 2000 broadcast scheme can be seen 
in Figure [T] 

The rest of this paper is organized as follows. In Section HIl 
we show some basic concepts of progressive resolution recov- 

'FEC gives the receiver an ability to correct errors without data retrans- 
mission. Over an erasure channel, the receiver either receives the paclcet or 
drop it when error is detected. 

- Note that video can also be transmitted in this broadcast network using 
MJPEG 2000, each frame of which can be seen as JPEG 2000 images. 
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Fig. 1: Framework of the proposed unequal error protected JPEG 2000 broadcast scheme with progressive fountain codes. 
Note that the notations in figure will be discussed in the following sections. 



ery of JPEG 2000. Section |III] contains our proposed progres- 
sive fountain codes for unequal error protected image/video 
transmission. The prototype of the proposed broadcast scheme 
is introduced in Section HV] Section [Vl shows the experimental 
results and compares our scheme with EE? schemes. Finally, 
we conclude the paper in Section [VT] 

II. Progressive Resolution Recovery of JPEG 2000 

One of most attractive characteristics of JPEG 2000 is that 
the progressive resolution recovery of compressed images, 
as a multi-resolution image representation, is inherent to 
Discrete Wavelet Transform (DWT) that is a key algorithm 
of JPEG 2000 standard. In this section, we shall concentrate 
on the decomposition technique of DWT, as the foundation of 
progressive resolution recovery in JPEG 2000. 

Assume I to be the input image to the compression 
algorithm of JPEG 2000. Let us first consider the one- 
dimensional DWT (1-D DWT). In 1-D DWT, the samples of 
one-dimensional signal x are passed through a low-pass filter 
ho and downsampled by a factor of two: 
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Similarly, the samples are also passed through a high-pass 
filter hi and downsampled by a factor of two: 
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Low-pass filter /iq and high-pass filter hi can be seen as 
the analysis filter-bank in DWT and an example is (5, 3) 
filter-bank, where /iq = (-1 2 6 2 - l)/8 and hi = 
(12— l)/2. The filtered samples yioiu and yhigh are 
normally named as wavelet coefficients. 

Then, two-dimensional DWT (2-D DWT) of image I can 
be conducted along the horizontal direction via 1-D DWT 



of each row of the image, and then conducted along the 
vertical direction via 1-D DWT of each column of the filtered 
and subsampled data. Such a 2-D DWT can be seen as 
the decomposition resulting in four subbands of filtered and 
subsampled wavelet coefficients, referred to as HH (high- 
pass filtering in both direction), HL (high-pass filtering along 
horizontal direction and low-pass along vertical direction), 
LH (low-pass filtering along horizontal direction and high- 
pass along vertical direction) and LL (low-pass filtering in 
both direction) subbands. Then, LL subband can be further 
decomposed into four smaller susbands with the same decom- 
position manner. As seen in Figure |2] k-level subbands can 
be achieved via decomposing the image k times and finally 
there are 3(fc — 1) + 4 subbands in total. Note that in this 
figure fcLL stands for LL subbands in k-level of the 2-D DWT 
decomposition. 

For a fc-level 2-D DWT decomposition of image I, the fc + 1 
level progressive resolutions of the image can be reconstructed. 
Towards progressive resolutions, JPEG 2000 defines resolution 
as the lowest resolution and resolution k as the highest 
resolution. Then, images at different resolution levels in JPEG 
2000 can be simply achieved via the wavelet coefficients stored 
in different subbdands of DWT. For example, resolution of 
the image can be reconstructed by the wavelet coefficients 
of fcLL subbands and resolution s of the image can be 
reconstructed by the wavelet coefficients of (fc — s + 1)HL, 
(fc — s + 1)LH, and (fc — s + 1)HH subbands combined with 
the image at resolution s — 1. 

Finally, the progressive resolution recovery of JPEG 2000 
can be achieved by encoding wavelet coefficients at differ- 
ent resolution levels into stream data W with a resolution 
increasing order using the quantization and entropy coding. 
Therefore, we have W = [idq, if i, if 2, •■•,'iffc], where wi is 
the layered stream data vector corresponding to the wavelet 
coefficients for reconstructing the image at level i, with 
corresponding bit rate being Wi in Mbps. 
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Fig. 2: K-level 2-D DWT decomposition. 

III. Progressive Fountain Codes 
A. Review of Fountain Codes 

Fountain codes can yield an infinite number of encoding 
symbols on-the-fly from K original symbols. In flU, it was 
demonstrated that all original symbols can be recovered as 
long as the receiver receives any {\+e)K encoding symbols. 
The overhead e is possible to be very slight and when K — > 
oo, e — > 0. In a word, fountain codes have achieved capacity- 
approaching behavior with very low overhead. 

LT codes is the first practical fountain code. At the encoder, 
the procedure of generating a encoding symbol is as follows. 
Firstly, a degree d is selected randomly from a degree distri- 
bution = X^i^i ^i^^ ^ where il; stands for the proba- 
bility of encoding degree i and satisfies X^ili — 1- The 
degree distribution should be carefully designed for efficient 
decoding and some distributions has been proposed, such as 
Ideal-Soliton distribution and Robust-Soliton distribution |4|. 
Secondly, d different input symbols are uniformly chosen 
from K original symbols. Thirdly, the encoding symbol is 
generated by performing bitwise XOR operation on d input 
symbols. If o? = 1, the encoding symbol is just a duplication 
of the unique input symbol. Lastly, the encoding symbol is 
transmitted. This procedure will be executed repeatedly and a 
potentially infinite encoding symbol stream can be generated 
until enough encoding symbols are collected at the client to 
recover all original symbols. 

At the decoder, the procedure of decoding is based on belief 
propagation (BP) |3- Firstly, BP process searches all receiving 
symbols with degree 1, which are exactly the corresponding 
original symbols. These symbols are stored in a buffer called 
ripple. Secondly, each symbol in the ripple is recovered and 
at the same time other symbols out of ripple are released 
which may be added to the ripple if the degree becomes to 1 . 
Since each receiving symbol is a linear combination of original 
symbols, of course the original symbols can be recovered by 
solving a linear equations called maximum likelihood decod- 
ing (ML) Q. BP decoding has lower decoding complexity 
and ML decoding has higher decoding efficiency. 
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Fig. 3: Structure of rate adjustment and interleaving. 

Moreover, in order to reduce the encding/decoding over- 
head. Raptor codes 12] have been proposed as an extension 
of LT codes with linear time encoding and decoding using 
a pre-coder of low-density parity-check (LDPC) codes. Our 
proposed progressive fountain codes also focus on Raptor 
codes. 

B. Progressive Fountain Codes 

As aforementioned, the layered stream data of JPEG 2000 
images can be represented by W = [wq, Wi,W2, Wk]. The 
priorities of each level decrease by i from to k. That is, data 
Wq with the highest priority must be decoded before all other 
data, while data Wf, with the lowest priority have to be decoded 
at last. Then, in order to enhance fountain codes with UEP 
property, we shall propose in the following two subsections a 
progressive fountain codes (PFC) scheme. The PFC scheme 
includes two steps: rate adjustment and Raptor encoding. 

1) Rate Adjustment and Interleaving: Data at different 
levels should be equalized by the rate adjustment. A list of 
coding rate r — [ro, ri, r2, r^] are assigned for data at 
different levels according to the priority, respectively. For all 
k + \ levels it satisfies < ri < r2 < ... < r^, where 
r," = — . Note that ni is the data bit rate at the ith level 
after rate adjustment. The encoder of rate adjustment may be 
any maximum distance separable (MDS) codes such as Reed- 
Solomon (RS) code. The encoded data with various levels are 
then collected together as intermediate data stream N, whose 
bit rate is 

k 
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Furthermore, the intermediate data N need to be interleaved 
since it is oriented to the packet transmission. After that, all 
data at various levels are protected proportionally with their 
priorities in terms of rate adjustment. Rate adjustment and in- 
terleaving are illustrated in Figure |3] Note that rate adjustment 
and interleaving are proceeded horizontally and vertically, 
respectively. The interleaved packets S = [si, S2, sk] will 
be passed to fountain encoder as input symbols. 
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Fig. 4: Overview of the prototype of the proposed unequal 
error protected JPEG 2000 broadcast scheme. 

2) Fountain Encoding: Standard systematic Raptor codes 
are performed to encode input packets S into output symbols 
O using the step of this subsection. Assume that the overhead 
of Raptor code is e, and then the overall transmission rate is 
o = (l + e)n. Here, e can be dynamically adapted according to 
the channel condition. Then, we can obtain the total overhead 
e* for original input stream W, 
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Although the Raptor encoder does not directly consider 
the priorities of data, the data at higher priority level can 
be recovered with higher probability because of the lower 
adjustment coding rate compared with lower priority levels. 

The advantage of our scheme is that no modification to 
the standard fountain codes structure is required, as to say the 
decoding efficiency can be guaranteed. However, a header with 
rate adjustment information of each level data is necessary at 
the receiver, producing extra few bits which can be practically 
neglected for the data in large blocks. 

IV. Prototype of the Proposed Broadcast Scheme 

As shown in Figure |4] the prototype of the proposed unequal 
error protected JPEG 2000 broadcast scheme consists of a 
server with a wireless LAN access point (AP) and three laptop 
user equipments (UE). The three UEs are distributed randomly 
around the AP as seen in this figure, in which UEl is the 
nearest while UE3 is the farthest shielded by two concrete 
walls. j)i indicates the packet loss rate (PLR) corresponding to 
each UE due to the channel quality influenced by the distance 
and shading, and hence we have Vi < V2 < Ps which will 
be shown in Section [V] Layered stream data of MJPEG 2000 
video are broadcasted via 802. llg at 2.4GHz by AP on a 
certain UDP port. Once connected to the AP, a user can join 
the broadcast group anytime to receive the stream data packets, 
being able to be decoded from anywhere in the stream since 
there is no inter-prediction between frame images of MJPEG 
2000 video. 



In contrast to the conventional broadcast schemes with 
equal error protection (EEP), the proposed scheme with UEP 
property is possible to serve more UEs with various channel 
conditions. In the proposed UEP broadcast scheme with PFC, 
the decoded resolution can be adapted to the channel quality, 
i.e. users with lower packet loss rate will acquire higher 
resolution frames while the users with higher loss rate can 
still be at least satisfied with lower resolution. 

Assume that we have N users with PLRs satisfying pi < 
P2 < ••• 1^ Pn- Given total overhead limited by broadcast 
bandwidth, first of all, overhead of Raptor codes e is designed 
to recover the lowest PLR pi, ensuring complete decoding 
of the user with best channel quality. Then, to maximize the 
average decoding level of all users, we can formulate our 
assignment problem of the adjustment coding rates r as 



N k 

ro<ri < ... < Tk 



s.t 
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Let S{pj,ri) denote the recovery result at PLR pj after 



decoding of adjustment coding rate and Raptor code. 



S{pj,r,) 



1, if recovered with rate Ti, 
0, otherwise. 



(6) 



Note that S{pj,ri) can be obtained from curves pre- 
generated by simulation. Thus the overall decoding level 
at user j is X]f=o "^fe' ^»)- ^i^i) denote the recovery 
capability of adjustment coding rate r^. 



P{n) = ma^{pj\S{pj,ri) = 1,1<.]<N} 



(7) 



Since we don't have an explicit expression of S{pj, Vi), the 
problem can be solved by a heuristic algorithm as follows. 

• Step 1: Adjustment coding rates r — [rp, ri, r2, rfc] 
are all initialized to recover at the highest PLR p^- That 
is, for any < i < fc, P{ri) = p^. 

• Step 2: The total overhead e*(r, e) is compared with Eq. 
If e*(r, e) > Cq then turn to Step 3, else the algorithm is 
terminated. 

• Step 3: For each i from 1 to k, try to increase to r'^ 
individually to make P(r^) = Pj+i^ if Pi^i) = Pj{^ < 
j < N). Let r[ = [ro, r^.i, r^, r^+i, rfe], we have 
the corresponding decrease of average decoding level 

= AVG{r)-AVG{r[). With m = argmin A^, make 
r = and return to Step 2. 

V. Results and Analysis 

In this section, experiments of MJPEG 2000 stream trans- 
mission with PFC are presented on the basis of the above 
prototype of broadcast scheme. We compared the results of 
our proposed UEP scheme and an EEP scheme with the same 
overall overhead eg = 0.2. In the experiments, we broadcasted 
a MJPEG 2000 720p high definition video stream, containing 
1316 frames decomposed into five levels as shown in Table |I] 
The assignment of encoding parameters of UEP scheme and 
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Fig. 5: Packet loss rates of three UEs, distributed as shown in 
Figure |4] 

TABLE I: The progressive resolutions and bit rates of MJPEG 
2000 encoding for the sample video stream. 

Wo Wi W2 Ws ■UJ4 

Resolution 80 X 45 160 X 90 320 X 180 640 x 360 1280 x 720 
Bit rate(Mbps) 1.603 3.200 8.326 9.773 3.544 



the equivalent of EE? scheme are shown in Table HI] and the 
block size of Raptor code is 510. 

Figure |5] demonstrates the packet loss rate per Raptor code 
block during the broadcast. The results meet our intuitive un- 
derstanding of the difference of channel qualities for broadcast 
scheme as introduced in Section |IV] Particularly, in UE3 some 
periodic bursts of packet loss happened, indicating that there 
may be a receive buffer overflow or a interference from another 
wireless equipment. Therefore, guaranteeing each user with 
various channel conditions to receive the multimedia becomes 
more challenging. 

Table [III] shows the statistical results of the received resolu- 
tion levels of the video for each user, in terms of Wq to W4, 
respectively. Note that the "fail" in this table means the frames 
being lost or decoded incorrectly. The average decoding levels 
of all frames are output in the last column. It can be seen from 
this table that the proposed scheme outperforms EEP scheme 
with a much lower failing ratio all the time, in particular the 
channel quality is bad as for UE3 such that it will receive a 
continuous video stream with the proposed scheme, yet a long 
interruption with EEP scheme. However, the average decoding 
level slightly decreased when channel quality is good as for 
UEl. Consequently, the proposed scheme can provide all users 
with a progressive performance of video stream transmission, 
i.e. all users can be served regardless of channel conditions. 

VI. Conclusions 

This paper has presented a JPEG 2000 broadcast scheme 
with progressive fountain codes, based on unequal error pro- 
tection for layered video streams. With the proposed progres- 
sive fountain codes in such a scheme, it was demonstrated that 



TABLE II: The assignment of encoding parameters of UEP 
scheme and the equivalent of EEP scheme. 



UEP 
EEP 







r2 




r4 


e 


127 


191 


223 


239 


247 


12 


255 


255 


255 


255 


255 


510 


217 


217 


217 


217 


217 


12 


255 


255 


255 


255 


255 


510 



TABLE III: Statistical experimental results of resolution levels 
of the received video for the UEs of Figure |4] 
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our broadcast scheme is capable of serving various users adap- 
tively with different resolution levels according to the channel 
quality. When the transmitted packets are at an extremely 
high loss rate, video streams can still be decoded with lower 
resolution by the proposed scheme while the conventional 
EEP schemes fail to decode. Experimental results suggest the 
superiority of our scheme versus EEP schemes, indicating that 
our scheme is insensitive to the channel quality and thus will 
be an efficient solution to multimedia broadcast systems in the 
future. 
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